Transfer of object shape knowledge across visual and haptic modalities
نویسندگان
چکیده
We investigate the hypothesis that multisensory representations mediate the crossmodal transfer of shape knowledge across visual and haptic modalities. In our experiment, participants rated the similarities of pairs of synthetic 3-D objects in visual, haptic, cross-modal, and multisensory settings. Our results offer two contributions. First, we provide evidence for a single multisensory shape representation common to both visual and haptic modalities. Second, our analyses suggest that these representations are part-based, representing objects as compositions of subparts.
منابع مشابه
Transfer of object category knowledge across visual and haptic modalities: experimental and computational studies.
We study people's abilities to transfer object category knowledge across visual and haptic domains. If a person learns to categorize objects based on inputs from one sensory modality, can the person categorize these same objects when the objects are perceived through another modality? Can the person categorize novel objects from the same categories when these objects are, again, perceived throu...
متن کاملSize-Sensitive Perceptual Representations Underlie Visual and Haptic Object Recognition
A variety of similarities between visual and haptic object recognition suggests that the two modalities may share common representations. However, it is unclear whether such common representations preserve low-level perceptual features or whether transfer between vision and haptics is mediated by high-level, abstract representations. Two experiments used a sequential shape-matching task to exam...
متن کاملWhy do four - year - olds show poor cross - modal transfer between haptic and vision ?
Four year olds have difficulty transferring information from the haptic to the visual modality. This difficulty may reflect qualitative differences in haptic and visual object representations or children’s inability to obtain the same kinds of perceptual information in the two modalities. Twenty 4year-olds explored novel objects either haptically or visually, then haptically chose a match from ...
متن کاملCross-Modal Scene Perception
We report the effect of cross modal performance on the recognition of familiar objects arranged in a scene. In two separate experiments, participants had to learn the position of objects in a scene either by viewing the objects (visual learning) or by feeling the objects (haptic learning). After learning, the experimenter swapped two of seven object positions and the participant's recognition m...
متن کاملEfficient visual recalibration from either visual or haptic feedback: the importance of being wrong.
The human visual system adapts to the changing statistics of its environment. For example, the light-from-above prior, an assumption that aids the interpretation of ambiguous shading information, can be modified by haptic (touch) feedback. Here we investigate the mechanisms that drive this adaptive learning. In particular, we ask whether visual information can be as effective as haptics in driv...
متن کامل